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Prefatory Note 



Tliis paper is an updated version of HumRRO 
l^rolVssioiial Paper 2-73, and is based on a presentation by Dr. 
SliclU at a briefing for the Deputy Chief of Staff for 
Individual Training, U.S. Continental Army Command, on 
25 Oetober 1972. 

The paper sunuiuu'izes some of the liumRRO literacy 
research and development performed for the U.S. Army since 
1968 under Work Units RI^ALISTIC (Determination of Read- 
ing, Listening, and Arithmetic Skills Reciuired for Major 
Military Occupational Specialties), READNEED (Methodology 
for Evaluating Reading Requirements of Army Jobs), and 
FLIT (Development of a Prototype' Job-Functional Army 
Literacy Training Progi'am). Under the first two Work Units, 
literacy needs for several Army MOSs were identified and 
methodology was developed for evaluating them. Under the 
current effort, FLIT, an (jxperimental training program is 
being designed to provide a level of funt!tional literacy 
appropriate to minimal MOS requirements. 

Members of the literacy reseach staff at HumRRO's 
Western Division m*e Thomas G. Sticht, Leader; John S. 
Caylor, Lynn C. Fox.Jlobert N. liauke, Rich:u*d P. Kern, SP5 
James IL James, SP5 Steven Sr^^^ Nina A. McGiveran, 

and William li. Burckhmlt. 
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HumRRvO's LITERACY RESEARCH FOR THE U.S. ARMY: 
DEVELOPING FUNCTIONAL LITERACY TRAINING 

'I'homas G. StichU John S. Caylor, Lynn C, Fox, 
Kol)erL N. llauke, Jamos M. James, Steven S. Snyder, 
and Richard i\ Kern 



Literacy research and develoi)ment i)rojects have been conducted by HumllllO since 
1968 under sponsorship of the Department of Defense, Office of Manpower and Reserve 
Affairs, and the Department of the Army, U.S. Continental Army Command. This 
reseiirch represents, so far a.s we know, the longest sustained, intense program of literacy 
research and development ever undertaken by the military, or for that matter, any 
large organization. 

This series of research and development projects has had two major objectives: first, 
to determine the nature of the literacy problem in the .Army by studying the literacy 
demands of Army jobs and the literacy skills of Army personnel, and second, to develop 
a literacy training program to provide job-related, functional literacy skills. 

DEFINING THE LITERACY PROBLEM 

Literacy Demands of Army Jobs 

Research to define the literacy problem was conducted under HumRRO Work Units 
RE.ALISTlC (Determination of Reading, Listening, and .Arithmetic Skills Required for 
Major Military Occupational Specialties), and READNEED' (Methodology for Evaluating 
Reading Requirements of Army Jobs), in these projects, we studied the literacy demands 
of Army jobs by a variety of methods. In one, we developed a special formula that 
permits an estimation of the reading gi'ade level of ability needed to read and compre- 
hend Army job manuals.' This ''readability'' formula was applied to samples of reading 
materials from seven Military Occupational Specialties (MOSs) into which larger numbers 
of marginally literate men might be assigned. 

The average reading difficulty level of materials in seven MOSs is shown in Figure 1. 
Also shown are the average reading ability levels of three groups of .Army personnel: 
Army Preparatory Training (APT), graduates for FYs 1968, 1969, and 1970., and 
Category IV and non-Category iV job incumbents studied^^ in HumRRO Work 
Units REALISTIC and UTILITY (Study of Soldiers in Lower Mental Categories: Job 
Performance and the Identification of Potentially Successful and Potentially Unsuccessful 

' Thonvas G. Slicht, John S. C;iyk)r, Richard P. Kuni, and Lynn C. Fox. Dctcrminution of Literacy 
Skill fiequiremcnls in Four Mililaiy Occupalional Spcciallic;:. HumF^RO Technical Report 71-23, 
November 1971. 

^John S. Caylor. Thomas G, Sticht, Lynn C, Fox. and J. Patrick Ford. Malhodolofiies for Defer- 
wining Reading Requiretncnls of M Hilary Occupational Specialties. HumRRO Technical Report 73-5, 
March 1973." 

Robert Vincberjjf. Thomas G. Sticht, Elaine N. Taylor, and John ' s. Caylor, Effects of Aptitude 
(AFQT). Job Experience, and Literacy on Job Performance: Summary of HumHRO Worh Units 
irnLirY and REALlSTiC, HumRRO Technical Report 71-1, February 1971. 
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Average Reading Difficuity Level of Materials in Seven MOSs 
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Men). The Figure shows considerable clispariiy bi'iweon the reading ahiliiy of lUTsoiinel. 
and the readability levC'S oT job [n-inied mattM-ial.s, whieh range IVom 10+ to 12th grade. 

The readability teehnitjue offers a low-cost, method for estimating the reading 
demands of job materials. However, it does not provide a direct indication of how weii 
people can read and comprehend job materials: for this information we need to test 
people on samples of job n.-ading materials. 

As a first step, structured interviews were conducicd with men of different reading 
ability levels who were working as mechanics, supply clerks, and ct^oks. The interview 
was conducted at the man s job location and lie was aski'd t(^ jirovidc* the following: 

(1) Personal data (Name. Unit. etc.). 

(2) A description of his typical work day. 

(,3) Five examples of his use of information sources other than primed 
materials. 

(4) Five examples of his us(? of printed materials (obtain the materials and 
locate the exact page referred to). 

(5) Five examples of duties or tasks pt^rformecl not involving use of printed 
materials. . ... 

(6) Five e.xamples of the uhv. of arithmetic. 

(7) Ways lo modify printed materiais to nicike them easier to u.se. 

Figure 2 shows the extent to which men of differing reading levels reportec' the use 
of job materials. Since each man could give, at the most, five citations of the u.se of 
reading materials, five citations is 10(j9r of the nKiximum possible: four citations would 
be of the maximum possible, and so forth. .As shown in the figure, for Supply 

Clerks :*nd Mechaiuits, the higher the reading level the greater the reported use of job 
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reading materials. For Cooks, there was a high reported usage of materials, mostly recipe 
cards. In general, however, the importance of these data is that they sug^.jst that men 
who have higher literacy skills will use job reading materials more frequently. 

The main purpose of the structured interview was to obtain samples of job reading 
materials actually used by job incumbents. With the materials in hand, we constructed 
reading tests using photocopied samples of actual job reading material, and asked 
questions to determine how weli people could locate and extract information from the 
job reading materials. We administered the Job Reading Task Tests (JRTT) for 
Mechanic's, vSuppIy Clerk's, and Cook's reading material to several hundred men at the 
Fort Ord reception station. We also administered a standardized reading test, so we could 
see how performance on the JRTT varied as a function of general reading ability. 

Data for men tested on the Cook's, Flepairman's, and Supply Clerk's job reading 
task tests are shown in Figure 3, which gives the percentage of men at each reading grade 
level who achieved either 50, 60, or 70% correct on the JRTT. Thus, for the Repairman's 



Men at Each Reading Grade Level Reaching Different Criterion Levels 
on Reading Task Test ((percent) 




Reading Grade Level of Personnel 
Figure 3 



test, somo 70 t of the mei) who read at tho eighth grade level achieved 70% correct. For 
Supply Specialists, only 207r of the men reading at the eighth grade level scored 70% 
correct or better on tho Supply Clerk's JRT1\ These curves clearly show that the Cook's 
job reading materials arc easier than the Repairman's, which, in turn, are easier than the 
Supply Clerk's materials. 

It* management wanted literacy training to provide reading training up to the point 
where 70% of the men could get 70% correct on the JRTT (the 70/70 criterion typically 
used in the .Army and other seiviees), the minimal literacy level for the C?ook's field 
would be 7 to 8, for Repairmen it would be 8, and for the Supply Clerks it would be 
12.0! This clearly exceeds the current APT goal of 5.0. Even the generous objective of 
70/50 would suggest a minimum targeted level of 6.0. 

.As a final approach to the problem of defining literacy demands of Army jobs, we 
studied job incumbents in the Armor, iMechanic, Supply, and Cook's jobs and compared 
their perform.ance on literacy tests and on three measures of job proficiency. In the 
present paper, only data concerning the relationship of reading to job sample and job 
knowledge test performance will be considered. Complete reports, as previously noted, 
are available from HumRRO concerning the renuiining relationships. 

For this research, 400 men were tested in each job. The job sample tests are 4- to 
. 5-hour individually administered tests in which rr^en performed actual job tasks. Figure 4 
shows a Mechanic repairing a vehicle while the -test administrator looks on. In Figure 5 a 
Cook is shown performing a job sample test, while Figure 6 shows an Armor Crewman 
responding to arm and hand signals in the Armor CrewmaaVs job sample test. A Supply 
Clerk works in a simulated office performing a job sample test in Figure 7. As illustrated 
in the four figures, the job sample tests are actual hands-on job tasks. 

The job knowledge tests were paper-and-pencil tests, constructed under the super- 
vision of HimiRRO research personnel in conjunction with Army content experts. The 
tests were designed to include questions about information actually needed to do 
the jobs. 

The percentages of Cooks, Mechanics, and Supply Clerks at various reading grade 
levels who scored 50% or better on the job sample and job knowledge tests are shown in 
^ Figure 8. .As vvith the job reading task tests, it is clear that reading ability is related to 
both of these measures of job proficiency, although, as expected, the relationship is 
strongest for the paper-and-pencil job knowledge test. 

\n the job sample data, the solid line is the average of three jobs. If we choose the 
not-too-exacting criterion of literacy at which 70% get 50% correct on the job sample 
test, the minimal literacy level would fall in the seventh gi'ade. it would be much higher 
for job knowledge, somewhere in the vicinity of the 12th grade! 

.Another way to consider the job proficiency and reading ability data is to see how 
well men perform relative to others in their job. Figure 9 shows data for Armor 
Crewmen. Here we have divided all the Armor Crewmen who took the job sample and 
job knowledge tests into four gi'oups: the top 25%. of performers, the next 25%, the next 
to bottom 25%, and the bottom 25%: For each reading ability level, we have presented 
the percentage of men in each quartile of proficiency. At the bottom of the figure is the 
pattern— -that is, the proportion of men in each quarter-^that we would expect to find if 
reading ability was not related to job proficiency— there would be 25% of all who took 
the test in each quartile. Over- or under-representation in each quartile occurs when there 
is a correlation between reading and job proficiency. 

Because of this correlation we see . that, for the job knowledge data, 59%- of the 
readers in the 4 to 5.9 grade level were among the bottom of 25%. of job performers. For 
the job sample data, 38% of the 4 to 5.9 gi'ade level readers were in the bottom quarter 
of job performers. 
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Quarter Distributions of Job Knowledge and Performance 
by Reading Grade Level: Armor Crewman (MOS 11 E) 

Expected Pattern for r 0 
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A similar rindin|4 holds for all four jobs, as Ihe ''visual impact'' figure (Figure 10) 
shows. 

To illustrate how these data were used to establish liie general minimal level of 
literaey for Army jobs/ we will use the Cook's data (Figure 11). What we did was to 
ehoose a decision rule stating that the lowest level of literaey that should be used to 
establish goals for literaey training is the level at which men would not be exjieeted to he 
over-represented in the bottom tjuartile of performers. Looking at the Cook's job 
knowledge data, we see that only at the 7-7.9 level does representation in the bottoni 
quarter fall equal to or below tiie expected 25%. SimiUirly, for the job sample data, the 
7-7.9 level is the one at whit:h people are not over-represented in the bottom quarter of 
performers. Thus, for both types of data, a seventh gi-ade level of reading proficiency 
seems desirable. 

Similar analyses applied to tiie Armor Crewman and Meciianic data suggest minimal 
levels of 8.0, while the Supply Clerk's job would be best provided for by a literacy 
program targeted to ninth grade reading ability. 

These analyses, coupled with the extensive data on job reading task test performance 
and on the readability of Army materials, suggest the conclusion that the muiimutn 
functional literacy level for the Army is seventh grade reading ability. Thus, remedial 
literacy training ought to be targeted to this level as q minimum. 

Reading Ability of Army Personnel 

Up to this point we have- discussed HumRRO research that has focu.sed on the 
reading demands of Army Jobs. The other side of the Army's literacy problem concerns 
the reading ability levels of the personnel available to do the Jobs. We have obtained 
several estimates of the reading ability levels of Army personnel. 

One set of data (Table 1) comes from Work Units REALISTIC and UTILITY, and 
show the reading ability levels of personnel just after Project 100,000 began. About 15% 
of the total Category IV sample were members of Project 100,000. As shown in the table. 



Table 1 

Reading Ability Levels for 

Army Job Holders: 
UTILITY-REALISTIC Data 

(percent) 



Grade 
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Quarter Distributions of Job Knowledge and Performance by Reading Grade Level: 
Comparison of Four MOSs 
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Quarter Distributions of Job Knowledge and Performance 
by Reading Grade Level: Cook (MOS 94B) 
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about 40% of Ihe MtMital Category !V personnel rtnid l)elow the 7.0 grade level, compiu-ecl 
to only S% of the non-Category IV men. 

Those data represent to a large part, pre-Frojeet .100,000 distributions of reading 
ability levels. 1*al)le 2 dat;> weri» or)talned al Fort Ord in SepttMiil^er 1970 and SeptembiM* 
1971 in conjunction with the development of Job Reading Task Tests on Work Unit 
RKADNEED, while Project 100,000 was in full swing. The table shows the percentage of 
men in each Armed Forces Qualification Test (AFQT) decile who scored below the three 
reading grade levels. The last column indicates that as many as 12% of those with AFQTs 
of 40-49 may read below the seventh gi*ade level, and that the proportion increa.ses as 
AFQT decreases. 

Table 2 



AFQT and Reading Ability 

(percent) 
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(N=2,300) 
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22 
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37 


10-19 


6 


26 
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Our most recent data on the reading levels of Army personnel were obtained in 
February and March 1972 when we monitored the reading t(?sting of Category IV men at 
all Army APTs. During this period, CON ARC reviewed the continued need for APT after 
Project 100,000 was discontinued and entry requirements for Category IV men were 
raised. These data are for post-Project 100,000 personnel. Data from five APTs con- 
cerning the numbers and percentages of Category IV men scoring at various reading grade 
levels are presented in Table 3. The last column shows the cumulative percentage of men, 
and indicates that 11% of men scored below the 5.0 level, the target level for the current 
APT program. Thirty-three percent fall below the 7.0 level recommended by HumPRO 
on the basis of the data reviewed earlier. 

From these data, we can make estimates of the continued need for remedial literacy 
training in the Army. If the current APT target of 5.0 is maintained, 11% of Category IV 
personnel fall below this level. Rounding a little, we can say that some 10% of 
Category IV men will qualify for APT. Since, by DoD quota directives. Category IV men 
can be expected to make up at least 20% of the Army's input, some 10% of 20% of all 
recruits will qualify for APT. If the Army input in a year is 100,000 men, 20,000 will be 
Category IV men, of whom 2,000 will qualify for APT under present standards. 

If the standards are raised to 7.0, then 33% of the new, higher quality Category IV 
men, or roughly 6,500 men per year (based upon 100,000 input), are predicted to 
qualify for remedial literacy training. 
O 



Reading Levels of Category IV Men Screened for 
Army Preparatory Training (APT)^ 

(N 1.625) 
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91 
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5.0-5.,' 


89 
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16 


5.5-5.9 


97 


6 


22 


6.0-6.4 


114 


7 


29 


6.5-6.9 


71 


4 


33 


.7.0-7.9 


288 


18 


51 


8.0-8,9 


242 


15 


66 


9.0-9.9 


191 


12 


78 


10.0-10.9 


147 


9 


87. 


11.0-11.9 


141 


9 


96 


12.0-12.6 


'67 


4 


100 



^Test Period, Feb-Mar 1972; Forts Ord, Jackson. Leonard Wood, 
Dix, and Knox. 



Summary of HumRRO's Work on Defining the Literacy Problem 

To briefly summarize what we have learned about the Army's literacy problem: We 
have seen that (a) by a VcU'iety of methods, the reading demands of Army jobs, even the 
less complex ones, far exceed the reading ability levels of many personnel; (b) there is a 
positive relation between reading ability and job proficiency; (c) the present goal of Army 
remedial literacy training falls considerably short of the reading demands of the jobs; and 
(d) even with higher mental aptitude enlistment standai'ds, there is a need for remedial 
literacy training, whether the objective is fifth grade ability or the more realistic minimal 
objective of seventh grade a^ihty. This need is likely to increase as the Army becomes an 
all-volunteer force. 

DEVELOPING JOB-RELATED, FUNCTIONAL LITERACY TRAINING 

Work Unit FLIT: Objectives and Procedures 

Let us now turn to HumRRO's present, CON ARC-sponsored literacy research— Work 
Unit FLIT (Functional L/Teracy). This Work Unit was initiated in September 1971 as a 
result of discussions between HumRRO and CONARC regarding the apparent discrep- 
ancies between the literacy demands of jobs, as described above, and the current 
objectives of Army Preparatory Training. 

The general objective of FLIT is to develop a prototype literacy training program 
for the Ariny that will provide a level of functional literacy appropriate to present 
minimal MOS reading requirements. The program developmental effort operates under 



two major constraints: T\w program is not to exceed tlie present AFF duration of six 
vveeks» and it is not to lower current APT standards (i.e.» grade 5.0 achievement). Within 
these constraints, the FLIT developmental effort is concerned with the total set of 
components in an instructional system, including selection of students and instructional 
staffs development of instructional curriculum^ materials, and methods, imd pro- 
gram evaluation. 

The developmental progi*am got under way around 1 October 1971, and is presently 
scheduled for completion 30 June 1973. if desired l)y the Army, an implementation- 
dissemination phase will be undertaken during FY 74. 

In planning for the FLIT experimental program, visits were made to AFTs at Forts 
Dix, Jackson, Polk, Lewis, and Ord, as well as the Air Force literacy school and the loi'ge 
Job Corps center at San Marcos, Texas, in order to locate exemplary practices for 
possible inclusion in the FLIT program. Site visits to the .APT schools showed that a wide 
vtu'iety of programs were in effect, but nothing of an exemplary nature. Both civilian and 
military personnel were found as instructors; administrators were always civilian; and 
there were no consistently applied criteria for selecting instructors— most had college 
degrees, but many had had no experience in adult basic education. In some cases, school 
administrators had no training either in reading or in education administration. 

Materials differed from one APT to another, and ranged from an almost totally 
programmed, mechanized, expensive system especially designed for young adults to a 
heavy reliance on the ''Private Pete'* series developed in World War L reinforced by some 
more current workbooks from United States Armed Forces Institute (USAFI). Informa- 
tion about the success rates of the APT schools for FY 1970 and 71 wiis obtained from 
CONARC. Table 4 shows the number of men processed through each of eight APTs and 
the percentage of men who achieved the 5.0 level or above, in either Week 1. Week 3, or 
Week 6, the final week of APT. 

The percentage of men who achieved 5,0 in the first week varies fronr none at Fort 
Ord to 70% at Fort Knox, with the overall average for CONARC at about 25%. The 
variation among APTs reflects the fact that testing in Week 1 of APT is not mandatory in 
CONARC directives; rather, teachers are permitted to recommend for retesting those 
whom they feel are qualified in the first week. Data obtained from the Fort Ord .APT 
- during special testing conducted during Week 1 indicated that about 507f. of the people 
qualified for graduation within two days of their arrival at APT. A basic conclusion from 
these data is that much of APT success can be attributed to testing artifacts, not the least 
of which is the hectic pace of the reception station testing. 

Additional activities during the planning phase of FLIT involved the collection of 
data from the APT school at Fort Ord and the Air Force literacy program. The data 
provide a standard to which the FLIT achievement data may be (compared relative to 
other military programs. 

As a consequence of our visits to the APT schools and a survey of literature on the 
ineffectiveness of previous Army, Navy, and Air Force attempts at literacy training, we 
concluded that (a) past achievement data reflect large amounts of testing artifacts, (b) the 
fifth grade reading level is inadequate for Army career fields, and (c) if a literacy training 
program of six weeks' duration is to have any direct effect on a man's subsequent job 
performance— either in job training or on the . job— -the literacy training should deal 
directly with the kinds of reading tasks the students encounter in AIT and on the job. 

With these considerations in mind, we have developed a literacy program that differs 
considerably from the current APT program. Both APT and FLIT are six weeks in 
duration— beyond this there is not much similarity.'' The objective of APT is grade level 

Actually, FLIT is only 26 clays rather than 30 days, because we must test men on Tuesday of the 
last week to get orders for AIT/CST by the end of the week, and to let men out-process. 
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Table 4 



Achievement Data for Army APT, 
FY 1970 and 1971 
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Fort Polk 
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Fort Campbell 


86 


2 


73 


12 


10 


4 


2,333 


Fort Knox 


83 


70 


9 


4 


12 


5 


3,068 


Foit Dix 


78 


29 


28 


21 


13 


10 


2,514 


Fort Jackson 


75 


20 


40 


16 


20 


4 


2,006 


Fort Lewis 


73 


10 


41 


23 


19 


8 . 


1,168 


Fort Ord 


70 


0 


49 


22 


18 


12 


1,062 


Fort Leonard Wood 70 


16 


46 


8 


19 


11 


468 


CONARC 


80 


26 


40 


15 


14 


6 


17,035 



5.0 in general reading, while the objective of FLIT is to provide students with the ability 
to use their \oh reading materials with the competency of a person having at least 7,0 
general reading ability. However, as the data presented earlier show, the Mechanic could 
use training up to a minimum of 8.0, while the Supply Clerk's job requirements are 
higher at 9.0. Thus, while the FLIT program tries to reach these higher levels, we know 
that there ii^ a limit to what can be accomplished, therefore our official minimum goal is 
the 7.0 level. 

The curriculum under the AFT program is a General Education Development (GED) 
program consisting of six hours daily of reading, writing, English grammar, arithmetic, 
and social studies. In planning the FLIT program, we took note of the fact that all 
previous attempts to improve job proficiency through GED training have failed and also 
that the GED curriculum has little direct bearing on job reading tasks. For this reason, 
the FLIT program uses the six weeks available to train men explicitly in reading and 
extracting information from job reading materials. Although we also include a general 
reading program, which provides literature and practical information about consumerism, 
citizenship duties, and other information relevant to life management, our primary 
emphasis is upon job-related reading. Much behavioral science research has indicated that 
learning is more likely to transfer from the school to the job situation when the school 
tasks closely resemble the job tasks. 

In order to focus reading training directly on a student's job reading materials, we 
must. know what his job is going to be. Since this information isn't available until several 
. weeks into Basic Combat Training (BCT), we have scheduled the FLIT program after 
BCT. Our survey of the reading demands of BCT showed very little need for reading, 
especially under the new performance-oriented program. 

Thus, by placing the FLIT program after BCT, the reading trainmg can be focused 
directly on a man's MOS reading materials. Also, time and money are saved by not 
providing literacy training to men who cannot complete BCT. Of 185 men who 
qualified for FLIT at the reception station testing, 24 (13%) were discharged during 
BCT. Thus, the post-BCT location for FLIT training effects some immediate cost 
savings for literacy training. 
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The lust two clifierouces between the APT and FLIT programs, Instructors and 
Directorate, are interrelated. APT is now under the Director of Personnel and Community 
Activities (DPCA) and operated by the Education Office. For the most part, the 
Education Office hires civilian instructors, although military personnel may supplement 
the civihan instructional staff. The FLIT progiani, however, has been placed in the 
regular training pipeline between BCT and Advanced Individual Training (AIT) or Combat 
Support Training (CST). Being job-oriented pre-MOS preparation, it is part of regulai* 
Army training, rather than an activity outside the training program for general educa- 
tional devc.opmenl, which may, but probably will not, make the men more able job 
performers— especially in only six weeks of remedial GEO. Since the FLIT program is 
considered an integral part of the Army training sequence, it is under the Director of 
Plans and Training (DPT), tuid uses military instructors (currently these instructors are 
research assistants from the U.S. .Army Human Research Unit, Presidio of Monterey, 
California.) The FLIT experimental school is being conducted at FortOrd. 

The FLIT instructional Program 

.An overview of the FLIT instructional program in job reading as of September 1973 is 
pre.sented in Figure 12. This figure shows the flow of students through the FLIT job 
reading program. First, men are tested at the reception station using the present APT 
screening test, the USAFI Intermediate .Achievement Test, Form D. Since we are aiming 
at 7.0 proficiency, we have raised the entry cutoff score from 4.9, the current .APT 
cutoff score, to 6.1, which is .9 of a grade unit difference below the tai-get goal of 7.0. 
This difference has been introduced to try to reduce the numbers of people who might 
erroneously be sent to FLIT, because of testing artifacts of the kind mentioned earlier 
(i.e., some 50 to 709o of present APT success might result from testing artifacts). Present 
APT. accepts people reading at 4.9 and sends them out at 5.0. As \ve will show later, 
testing artifacts may produce as much as .9 of a year's gain, so we have introduced this 
difference between selection and target grade levels. 

If a man scores higher than 6.1, he goes directly to BCT; if he scores below 6.1, he 
is tagged for FLIT and then sent to BCT. If a man fails to complete BCT, he is no longer 
in the program. If he completes BCT and is not tagged for FLIT, he goes directly to 
AIT/CST; if tagged for FLIT, he is sent to the school and on the day of entry is 
administered the job reading task test for his MOS cluster, and the USAFI. If he 
performs well on both of these tests— about 7.5 averaged over the two tests— we initiate 
action to move him along to AIT/CST. If he does not do well, he is entered in the job 
reading program. 

In the job reading program, he enters Module 1, which provides practice in using 
tables of content from manuals in his MOS. When he first enters the TOC module, he 
takes a proficiency test. If he passes the PT, he skips the printed materials in the TOC 
module and takes an audio PT. If he passes the audio PT, he goes on to the module on 
Indexes and follows a similar procedure. Whenever a man fails a PT, he must com.plete 
the work of the module and take a post-module PT. If he passes the post-PT with 90% 
correct in less than 20 minutes, he proceeds to the next module. If he fails either the 
accLu-acy or the time criteria, he is recycled through additional work in the module until 
he masters the content. 

.At the end of this sequence, the man is retested on his JRTT and an alternate form 
of the USAFI test. If he passes both, or averages above the 7.0 level, he is releases from 
FLIT with orders to AIT/CST. If he fails the end of program tests and is in the sixth 
week, he is sent along to AIT/CST. If he is not in the sbcth week, his JRTT test scores 
are examined to see where he needs more training and an individually prescribed 
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FLIT Job Reading Program as of September 1973 
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instructional skiiumki* is inacio up Tor him. lie continues this cyclo until ho passes the 
tests or six weeks are up. and is then sent alon^ to Afr/C'ST. 

The joh reading program just described is currently in use with materials for six 
career clusters: Combat. Medic. Cook. Communication. Clerical, and Mechanical. The job 
reading matOi'ials for the Combat, Medic, Cook, and Communication clusters are shown in 
Table 5, while Table 6 shows the materials for the Clerical and Mechanical clusters, as 
vvell as the various DA forms that are taught. 

Table 5 



Job Reading Materials for 
Combat, Medic, Cook, and Communication Clusters 



Co mbat 


Medic 


Cook 


1 ' 

Communication 


FM 


7-11 


FM 8-10 


TM 


10-405 


TM 1 1-5805-201-12 


FM 


22-5 


1 IVI O J«J 


TM 


10-415 


TM 1 1 

1 IVI II OO 1 


FM 


238 


FM 8-50 


TM 


10-419 


TM 11-2134 


FM 


23-11 


TM 8-230 


AR 


30-1 


TM 11-5805-262-12 


FM 


23-12 




TM 


10-412 


TM 1 1-5820-401-10 


FM 


23-16 








TM 1 1-5820-520-12 


FM 


23-67 








FM 24-20 


FM 


23-90 








TM 11-381 


FM 


9-1005-224-10 








TM 11-5820-398-12 


FM 


9-1345-200 










FM 


21-6 










FM 


5-20 










FM 


2371 










FM 


239 











-The series of photographs (Figures 13 through 27) illustrate the FLIT Job Reading 
Program flowchart presented in Figure 12. The photographs show the progress of a man 
through the program, beginning with a picture of the FLIT school (a converted mess hall) 
and ending with a picture of a man who has successfully completed the USAFl and 
JRTT being presented with a certificate (ready to go on to AIT/CST). 

In Figure 17, the reading worksheet packet assigned to the student will be for a 
table of contents, if it is the student's first week. In selecting an in.structional guide 
(Figure 18) the student is receiving incidental training in filing skills. The instructional 
guides are photocopied parts of technical mai-iuals that permit the student to focus on 
one part of the manual at a time. An advanced student uses manuals rather than 
instructional guides (Figure 19). After the USAFf and JRTT tests, if a man needs more 
instruction he is recycled through additional job reading. 

This is the current job reading component .pf FLIT. As the development effort 
continues, we expect to modify this component and add job reading training that will 
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Table 6 



Job Reading Materials for 
Clerical and Mechanical Clusters 



Cler iciil 


Muchtjnjca) 


DA Forms 


— ] 

AR 725-50 


TM 9-2320-218-20 


2765 


AR 210-130 


TM 21-305 


2402 


AR 735-1 1 


TM 9-2320-209-10 


2408 


Mn /UU*o*4 


\ M y-ouuu 


2408-1 


AR 710-2 


TM 9-2320-209-20 


2400 


AR 710-1 


TM 9-2320-218-10 


2408-7 


AR 735-5 


TM 9-8024 


2408-8 


v-» 1 %}\J'Zf\J 1 


T^/l Q OAO 


OA r\A 


TM 38-750 


TM 9-2320-244-20 


2765-1 


DA PAM 310-1 


TM 21-300 


2407 


DA PAM 310-7 


TM 38-750 


DA-1 


AR 680-1 


FM 20-22 


173 


DA PAM 310-2 




3034 


FM 21-6 




3327 






314 






2062 






201 






2867 



emphasize .basic word attack skills, higher level comprehension skills, and job concepts 
and principles. The current materials that we are using lor word attack and compre- 
hension iire non-job related cind make up the other major component of the FLIT 
curriculum^the developmeniaU or general readu-ig, component. The students usually 
divide their time between tliree hours of job reading and three hours of general reading 
per dc\y. 

The general reading is conducted in a manner similar to the job reading: A student 
receives a general reading work assignment sheet, then picks materials from one of the 
kits of graded difficulty level, or he may work on a graded novel with accompanying 
worksheets. After getting his materials, the student gets a sttirting time score, then works 
on his materials either independently or in a group listening to a selection. When *he 
finishes his worksheet, a peer-scorer corrects it, and the man goes on to his 
next assignment. 

In aUuition to this experimental core curriculum, we have reading, writing, and 
discussion activities over which instructors have discretionary control. In designing the 
FLIT program, we are careful to leave some discretionary time to the instructors, so as 
not to stifle their creativity and interest. 
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Figure 19 An advanced student selects his 
job manual. 
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Figure 20 After getting his worksheets and job manual, the 
student's starting time is recorded by a peer 
timer/scorer. 
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Figure 21 



Students work on job reading worksheets. 



Figure 22 Student working on forms module. 





Figure 27 Man who successfully completed the USAFI 
and JRTT is given a certificate. 
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Characteristics of FLIT Students 



For the first 16 classes, 170 men entered the FLIT program. Detailed descriptive 
data were obtained from an extensive questionnaire administered individually to the first 
six classes. This practice was halted because of the length of time required for the 
interview. The questionnaire was later reinstated as a take-home item, so we have data for 
about 130 of the 170 men. In the tables that follow, numbers fluctuate because of 
missing information. 

The ages and education levels of students in the first 16 FLIT classes are shown in 
Table 7. The median age is 19, and median years of education completed is 12. Eighty- 
five out of 130 (over 60%) reported having a high school diploma or GED equivalency, 
which contrasts sharply with the mean entry reading grade level of 6.0 in the data for the 
men in the first 12 classes. 

Table 7 

Age and Education Levels of 



FLIT Students-16 Classes 


Age 


N 


Education 


N 


17 


9 


7 


3 


18 


15 


8 


5 


19 


40 


9 


14 


20 


44 


10 


1 1 
t f 


21 


7 


11 


10 


22 


3 


12 


69 


23 


5 


13 


7 




2 


14 


2 


25+ 


4 


. 15+ 


4 


Total 


129 


Total 


131 






High School Diploma 


81 






GED 


4 






No High School Diploma 


45 . 






Total 


130 



The ethnic groups represented in the FLIT program offer quite a variety, as Table 8 
shows. Some two-thirds of the men are non-Anglo-American. About 25% of the men in the 
FLIT program up to now have been foreign born, with more than one-half these men 
having Jived in this country for one year or less. 

The large range of ethnic groups and number of foreign born individuals imply 
considerable language variation, which Table 9 confirms. Here we see that, although 
English is the primary language for more than 60% of the sample, many of the men have 
a primary language other than English, with Spanish the next most common language. 

It is clear from these data that much of the literacy problem at the FLIT school 
goes beyond students having inadequate reading, decoding, or word-attack skills; much of 
the problem is a language problem. In the FLIT job reading program, the man with 
marginal English language skills is provided practice in using these skills in working with 
job reading materials. 
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Table 8 



Ethnic Group and Foreign Born 
FLIT Studen($-16 Classes 



Ethfiic Group 


N 


Foreign Born 


Time in USA 
(Months) 


N 


Anglo-American 


49 


1-3 


10 


Negro 


17 


4-6 


2 


Oriental 


10 


7-12 


6 


Spanish-American 


23 


24 


4 


Polynesian 


27 


36 


3 


American Indian 


3 


48 


1 


Total 


129 


50+ 
Total 


6 
32 

(25%) 
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Language Background of 
FLIT Students- 16 Classes 





Students' 


Language 


Language 


Primary 


Spoken 




Language 


in Home 


English 


86 


70 


Tagalog 


7 


6 


Spanish 


11 


26 


SaiTtoar. 


8 


7 


Japanese 


2 


2 


Chinese 


2 


2 


Korean 


2 


3 


Guamanian 


6 


5 


Eskimo 


1 


1 


Microneslan 


1 


1 


American Indian 


2 


2 


Total 


128 


125 



Effectiveness of the Training Program 

The effectiveness of the FLIT program is indicated by (a) the number of people who 
reach criterion after going through each written and audio module; (b) the improvement 
in general and job reading test scores obtained in the first and last weeks of the FLIT 
program compared to such improvement obtained by other DoD reading programs and a 
no-reading-training control group; and (c) the number of men who achieve the minimal 
target objective of grade 7.0 performance on the job reading task tests. Each of these 
indicators of effectiveness is discussed. 

O 
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As was indicated in Figure 12, each career cluster has a Table of Contents, Index, 
Tables and Graphs, and Body of the Manual modules with printed and audio com- 
ponents, and a Procedural Directions module with a printed but no audio component/^ 
Each component has a pre-test and a post-test. 

Table 10 shows the percentage of students vvho successfully passed the pre-test for 
each written component, the percentage who achieved the criterion level of performance 
after completing the module, and the percentage who failed the post-test or did not 
complete the module. These data are for all six career areas combined, and include FLIT 
classes of 40 through 60 (the twenty weeks of input into the school just prior to 
this writing). 

Table 10 

Written Module Performance: FLIT Students 











Failed or 






Passed 


Passed 


Did Not 






Pre-Test 


Post-Test 


Complete 


Module 


N 


% 


% 


% 


Table of Contents 


112 


27 


66 


7 


Index 


111 


14 


69 


16 


Tables and Graphs 


ni 


37 


53 


to 


Body of Manual 


107 


0 


70 


30 


Procedural Directions 


81 


4 


3b 


61 



It is clear from Table 10 that the Tables and Graphs module is the easiest, being 
successfully challenged by some 37% of the students, while the Body of the Manual 
(BOM) module is most difficult, with none of the students successfully challenging 
the module. 

In regard to the Failed or Did Not Complete column, it should be pointed out that 
buiae students did not achieve proficiency in a given module in three or four recycles, 
and hence ihey were moved into the next module to make sure, that all students had 
some -exposure to all the different job reading tasks before the six weeks of school were 
completed. While this practice precluded strict adherence to mastery performance criteria, 
the modules are not necessarily hierarchical and so cumulative deficits in skills would not 
result. Attempting to achieve mastery did, however, result in a fairly large number of 
students (61%) who failed to complete the difficult Procedural Directions module satis- 
factorily. This module comes near the end of the program, and many slower learners had 
to be moved ahead to learn about their MOS forms without achieving criteria levels of 
proficiency on the Procedural Directions post-test. 

Table 11 shows comparable data for the audio components of each module. As 
indicated, the Tables and Graphs module, is again the easiest, and the Body of the Manual 
module is the most difficult, with only some 17% of students successfully challenging the 
module on the pre-test. Additional analyses of these data indicate that students who 
failed to reach criterion did so mainly because of the time rather than the accuracv 
component of the criterion (i.e., 90% correct within 20 minutes). 

The data of Tables 10 and 11 indicate in criterion-referenced measurements of 
job-related reading that FLIT students are indeed acquiring job-relevant reading skills. 

^The Forms modules do not have overall module pre- and post-tests for proficiency. Rather each 
form is its own separate **sub-moduIe.'* Hence no pre- and post-test proficiency data are presented for 
Forms. 
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Table 11 



Audio Module Performance: FLIT Students 











Failed or 






Hussud 


Passud 


Did Not 






PiuTost 


Post-Test 


Coni^jietu 


Modulu 


N 


% 


% 


% 


Table of Contents 


88 


46 


39 


16 


Index 


93 


27 


37 


37 


Tables and Grdphs 


80 


55 


24 


21 


Body of Manual 


70 


17 


50 


31 



Table 12 prestfiits achievomciiL of h'LlT ytudenLs in clasties 1-53 in ternis of notinaiwe- 
referenced measurement of general reading skills. The general reading test used is the 
USAFl hiterinediate Achievement Lest, wliicii is routinely used to screen sLudetitK for 
Army literacy programs. 

Table 12 



General Reading: FLIT, Air Force, and 
Army APT Literacy Programs 







Average Grade Level 






Literacy 




Reception 




Exit 


Unadjusted 


Adjusted 


Program 


N 


Center 


Week 1 


Week . 


Gain 


Gain 


FLIT^ 


304 


5.0 


5.9 


6.6 


1.6 


.7 


Air Force 


277 




5.2 


6.7 


1.5 


1.5 


APT^ 


8.999 


4.0 




5.6 


T6 


.7 



^FLIT and APT are 6 weeks in duration; Air Force program is 13 weeks long. 



As Table 12 .shows, 304 men participated in the first 53 classes (weeks) of the FLIT 
program. Tested at the reception station, they had an average reading grade level of 5.0. 
After BCT, and on tlie first day in the FLIT school, they were retested on general 
reading, and scored 5.9, which is .9 of a grade unit above their reception station score. 
This is the gain mentioned earlier when it was said that .9 of a grade level may he 
attributed simply to testing artifacts. 

The average exit score from FLIT was 6.6, a gain of 1.6 years if we compute gain in 
the FLIT program as the difference between the reception station and exit week scores, 
as is the policy in APT. The contrast \vith the Air Force and APT programs can be seen in 
the Unadjusted Gain column. In ih^ Adjusted Gain column we have subtracted the .9 gain 
due to testing artifacts. On general reading, the FLIT gain is 0.7 years, which is .8 below the 
Air Force but equal to the current APT. With regard to the FLIT and Air Force differences, 
the Air Force program is explicitly geared to general reading, while the FLIT program is 
oriented toward job-related reading. In addition, the Air Force program is 13 weeks long, 
while the FLIT and APT programs are less than half that, at six weeks. 

In terms of job-related reading. Table 13 compares a sample of students tested at 
the APT programs at Forts Knox and Ord, and the Air Force program, with men in FLIT 
classes 1-39 (major revisions were made to the FLIT program, including revisions to 
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Table 13 



Job Reading: FLIT, Air Force, and 
Army APT Literacy Programs 



Literacy Program 


N 


Grade Level 


Enter 


Exit 


Gain 


FDT 


149 


6.8 


8.7 


1.9 


APT 


124 


4.7 


5.2 


0.5 


Air Force 


56 


6.1 


6.7 


0.6 



job-reading task tests, for classes 40 on. The job reading test data reported in Table 13 
were all obtained with the original tests and are hence comparable). 

The data of Table 13 clearly indicate the advantage of direct job-related reading 
training on performance of job reading tasks. The FLIT gain is three to four times that 
of APT of the Air Force. 

To further evaluate the FLIT program following the revisions for classes 40 on, a 
group of Army personnel entering the Light Vehicle Drivers School at Fort Ord were 
tested for general reading and job reading ability on the first and last weeks of their MOS 
training. Thus these men received no general reading training or direct, extensive training 
in job reading as given in the FLIT school, although of course they were introduced to 
Army job reading materials. 

T^lile 14 shows how well the FLIT students did on general and job reading task 
tests compared to Army personnel in the Light Vehicle Drivers School who scored below 
the 7.0 grade level on the USAFI general readiilg^test on entry into their MOS training. 
We note that the students who received no literacy training improved 1.0 grade level in 
general reading— again reflecting gain that can be obtained simply through retesting at a 
later date. " ' 

Table 14 

FLIT Students Compared to No Literacy Training Group 







General Reading 


Job Reading 


Students 


N 


entry 


Exit 


Gain 


Entry 


Exit 


Gain 




94 


5.1 


^' 6.6 




1.5 


5.4 


8.0 


2.6 


No Literacy Training 


39 


5.6 


6.6 




1.0 


6.3 


7.4 


1.1 



^Classes 40-60. 



Regarding job-related reading, the FLIT students gained some 2'/2 years, while the 
non-literacy-trained personnel improved by one grade level. Again, the effectiveness in. 
direct training in job-related reading is demonstrated. 

Table 15 shows the percentage of men in the FLIT school who scored at the 
minimum of 7.0 on the USAFI and JRTT at entry and exit from the program. It should 
be recalled that the cutoff score for entry into the FLIT school when the USAFI test is 
given at the reception station is 6.1. Hence the data of Table 14 for the entry general 
reading test show how many people scored at or above the- 7.0 level when retested during 
their first week in FLIT. As indicated, 12% of the people were at or above the 7.0 level 
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Table 15 

FLIT Program^ 
Students Achieving Grade Level 7.0 



Testing 


Reading Test 


General 


Job Related 


N 


% 


N 


% 


Entry Week 


67 




12 


67 


18 


Exit Week 


67 




55 


67 


84 


Gain 






43 




66 



^Classes 40-58, 



when rotcsted on the first day in FLIT, while at the exit week 55% obtained the 7.0 
level, for a 43% gain in numbers achieving the seventh grade level in general reading. 

VVe see a larger gain for personnel who achieved 7.0 on the job reading task test, 
with 84% of the men reaching the targeted level, representing a 66% gain in personnel 
achieving minimal MOS reading proficiency. 

Summary of Developmental Effort 

This, then, is the program, the people, and the progress of the FLIT developmental 
effort after one year of input, or about one-half of the way through the developmental 
phase. We believe that the data obtained so far offer encouragement for continued effort. 

As in the past, the FLIT developmental effort will continue to be guided by these 
principles which have proven successful in a wide variety of training contexts: 

(1) Functional Training ! "T-hrough the use of actual job reading material, the 
man sees the purpose for the reading training in concrete terms of job proficiency, not in 
general educational development, which they have failed many times in the past. 

(2) Performance Orientation . This training permits the men to perform the 
kinds of reading tasks they will encounter in job training and out on the job; thus there 
is a direct transfer of skills learned in FLIT to the AIT/CST and job. 

(3) Individualization . Individualized training permits men to work at the rate 
suitable for them, and with materials oriented toward their jobs. 

(4) Student Assistance . Students participate as instructional aides and 
peer-instructors to relieve pressures on teachers and to help **stamp in'' what they learn 
in FLIT. 

(5) Quality-Control . During training, quality control in the form of modular 
instructional units with end-of-module proficiency checks aims to provide students and 
instructors with immediate feedback about learning achievements and deficiencies, so that 
corrective action can be taken. 

(6) FoUow-Up . Questionnaires to follow up FLIT graduates provide feedback 
for making the FLIT job reading program faithful to the AIT/CST reading demands. To 
date we have sent out 353 follow-up questionnaires, and have had 74 (or 20%) returned. 
Eight out of 10 felt that one or more of the FLIT activities helped them in their MOS 
training, and several have suggested additional material to be included in the FLIT school. 
We believe that with this continued interaction between the development staff and FLIT 
graduates, gaps between job reading demands, job reading training, and personnel reading 
skills will continue to be closed. 
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